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WHITE BALANCE CONTROL AMOUNT CALCULATING DEVICE 

BACKGROUND OF THE INVENTION 
1 . Field of the Invention 
5 The present invention relates to an electronic still 

camera by which an image signal obtained by an imaging device 
is recorded, and especially, to a device which calculates a 
white balance control amount for adjusting a color of a color 
image obtained based on the image signal . 

10 2. Description of the Related Art 

Conventionally, for calculating a white balance control 
amount, there is known a device in which only pixel signals of 
achromatic color are extracted from all of the pixel signals 
forming a single image, and the white balance control amount 

15 is calculated based on the pixel signals of achromatic color. 
Namely, in the pixel signals of the achromatic color, pixels 
other than the subject image, which the photographer intends 
to photograph, are contained. On the other hand, there is 
known another device, in which a white balance control amount 

20 is calculated using all of the pixel signals forming the 
single image. In the latter device, similarly to the former 
device, pixels other than the subject image, which the 
photographer intends to photograph, are contained. 

When a tint of an image portion of the subject to be 

25 photographed and that of an image portion other than the 
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subject are close to each other, the white balance control 
amount would be proper even though pixel signals included the 
portion other than the subject. Conversely, when tint is 
drastically locally varied in the image, the white balance 
5 adjustment may not be performed properly for the subject to be 
photographed . 
SUMMARY OF THE INVENTION 

Therefore, an object of the present invention is to 
provide a white balance control amount calculating device by 

10 which a white balance adjustment can be always properly 
performed regardless of the tint of the image as a whole. 

According to the present invention, there is provided 
a white balance control amount calculating device comprising 
an image signal generating processor, an image area extracting 

15 processor and a control amount calculating processor. 

The image signal generating processor generates an 
image signal corresponding to a first image formed on a light 
receiving surface of an imaging device. The image area 
extracting processor extracts at least one image area, which 

20 contains a second image of a subject positioned at a 
predetermined distance from an electronic still camera, from 
the first image. The control amount calculating processor 
calculates a control amount for performing a white balance 
adjustment, based on the image signal relating to the at least 

25 one image area. 
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Further , according to the present invention, there is 
provided a device for calculating a white balance control 
amount for an electronic still camera which photographs an 
image containing at least one subject and at least one portion 
5 other than the subject, the white balance control amount 
calculating device comprising an imaging device, an image area 
extracting processor and a control amount calculating 
processor. 

The imaging device generates an image signal 
10 corresponding to the image. The image area extracting 

processor extracts at least one image area, each containing 
one of the aforementioned at least one subject, from the 
image. The control amount calculating processor calculates a 
control amount for performing a white balance adjustment, 
15 based on the image signal relating to the image area. 
BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present invention 
will be better understood from the following description, with 
reference to the accompanying drawings in which: 
20 Fig. 1 is a block diagram showing an electronic still 

camera provided with a white balance control amount 
calculating device of a first embodiment of the present 
invention ; 

Fig. 2 is a block diagram showing a construction of a 
25 light beam projection unit; 



Fig. 3 is a perspective view showing an interchangeable 
lens and a focusing ring mounted in the interchangeable lens, 
in which the interchangeable lens and the focusing ring are 
disassembled; 

5 4 is a view showing an example of an image 

observed through a view-finder; 

Fig, 5 is a view showing a principle behind a distance 
measurement ; 

Fig, 6 is a timing chart showing a distance measurement 
10 light beam, a reflected light beam, a gate pulse and a 
distribution of an amount of a light beam received by a CCD; 

Fig, 7 is a plan view showing a disposition of photo- 
diodes and a vertical transfer unit, which are provided in the 
CCD; 

15 Fig. 8 is a sectioned elevational view of the CCD; 

Fig. 9 is timing chart of a distance information 
sensing operation by which data, corresponding to a distance 
from an electronic still camera to each point on a surface of 
the measurement subject, is sensed; 
20 Figs- 10A and 10B show a flowchart of a white balance 

adjustment routine of the first embodiment; 

Figs. 11A and 11B show a flowchart of a white balance 
adjustment routine of a second embodiment; and 

Fig. 12 is a histogram, m which a reciprocal number 
25 of a distance "d" from the electronic still camera to the 
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subject is defined as the axis of abscissas and a number of 
pixels corresponding to the distance is defined as the axis of 
ordinates . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
5 The present invention will be described below with 

reference to the embodiment shown in the drawings . 

Fig. 1 is a block diagram of an electronic still camera 
with a white balance control amount calculating device of a 
first embodiment of the present invention. 

10 The electronic still camera is a single-lens reflex 

camera, and an interchangeable lens 11 is electrically 
connected to an electric circuit provided in the camera body 
through mount pins 12 and 13. A front lens group 14 and a 
rear lens group 15 are mounted in a lens barrel of the 

15 interchangeable lens 11 , and an aperture 16 is provided 
between the lens groups 14 and 15. Each of the lens groups 14 
and 15 is displaced in the optical axis direction under 
control of a lens control circuit 17 , so that a focusing 
adjustment is carried out. The lens control circuit 17 is 

20 operated in accordance with a control signal transmitted 
through the mount pin 12 from a system controller 31 provided 
in the camera body. The aperture 16 is operated in accordance 
with a control signal transmitted through the mount pin 13 
from an aperture drive circuit 32 provided in the camera body, 

25 so that the opening degree of the aperture 16 is adjusted. 
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The aperture drive circuit 32 is controlled by the system 
controller 31. 

In the camera body, a quick return mirror 21 is 
disposed on the optical axis of the lens groups 14 and 15. 
5 The quick return mirror 21 is rota table between an inclined 
state shown in the drawing and a horizontal state in which the 
quick return mirror 21 is rotated upward. A focusing glass 22 
is provided above the quick return mirror 21, and a pentagonal 
prism 23 is arranged above the focusing glass 22. An eyepiece 
10 lens 24 of a view-finder is disposed behind the pentagonal 
prism 23. 

A shutter 25 is provided behind the quick return mirror 
21, and an infrared cut filter 26 and an optical low-pass 
filter 27 are arranged behind the shutter 25. A CCD (i.e., an 
15 imaging device) is provided behind the optical low-pass filter 
27. Namely, the quick return mirror 21, the shutter 25, the 
infrared cut filter 26 and the CCD 33 are aligned on the 
optical axis of the lens groups 14 and 15. 

A rotating operation of the quick return mirror 21 is 
20 driven by a mirror drive circuit 34, and an open-close 
operation of the shutter 25 is driven by a shutter drive 
circuit 35. The mirror drive circuit 34 and the shutter drive 
circuit 35 are controlled by the system controller 31. 

Usually, the mirror 21 is set to an inclined state, so 
25 that light passing through the interchangeable lens 11 is led 
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to the pentagonal prism 23. In this state, the shutter 25 is 
closed, so that an optical path to the CCD 33 is shut or 
closed. Conversely, when a photographing operation is carried 
out, the mirror 21 is upwardly rotated under control of the 
5 miHrror drive circuit 34, and is set to the horizontal state. 
With the rotation of the mirror 21, the shutter 25 opens under 
control of the shutter drive circuit 35, so that light passing 
through the interchangeable lens 11 is radiated on a light 
receiving surface of the CCD 33. Namely, an image obtained 

10 through the lens groups 14 and 15 is formed on the light 
receiving surface, and thus an image signal corresponding to 
the image is generated in the CCD 33. 

A pulse signal generator (PPG) 36 is connected to the 
system controller 31, so that the pulse signal generator 36 

15 generates various kinds of pulse signals under control of the 
system controller 31. Based on these pulse signals, the CCD 
drive circuit 37, an A/D converter 38 and an image signal 
processing circuit 39 are driven, and an operation of the CCD 
33 is controlled by the CCD drive circuit 37. Namely, the 

20 image signal read from the CCD 33 is converted to a digital 
image data by the A/D converter 38, and is then subjected to 
a predetermined process by the image signal processing circuit 
39. A memory 40, having a capacity to store a few frame 
amounts of digital image data, is connected to the image 

25 signal processing circuit 39. 
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A monitor interface 41, a card interface 42 and a PC 
interface 43 are connected to the image signal processing 
circuit 39, These interfaces 41, 42 and 43 are controlled by 
the system controller 31. A back light 45 and a liquid 
5 crystal display (LCD) 4 6 are connected to the monitor 
interface 41 through a liquid crystal display drive circuit 
44. Based on the image data read from the memory 40, the 
liquid crystal display drive circuit 44 is controlled, so that 
an image is indicated by the liquid crystal display 46. A 

10 card connector 47 is connected to the card interface 42, and 
a PC connector 48 is connected to the PC interface 43. An IC 
memory card can be mounted to the card connector 47, and a 
personal computer can be connected to the PC connector 48. 

An AF sensor 51, a photometry sensor 52 and a 

15 projection unit 53 are connected to the system controller 31. 
The AF sensor 51 has a known construction, by which a 
photometry is performed so that an opening degree of the 
aperture 16 and an electric charge accumulation period (i.e., 
a shutter speed) of the CCD 33 are determined. The projection 

20 unit 53 is provided for radiating a distance measuring light 
beam to sense a distance from the electronic still camera to 
each point on the surface of the subject. 

An operation switch 54 and a condition indicating 
device 55 are connected to the system controller 31. The 

25 operation switch 54 is provided with a switch such as a 

-8- 



photometry switch and a release switch. The photometry switch 
is turned ON by partly depressing the release button, so that 
a photometry is carried out by the photometry sensor 52. The 
release switch is turned ON by fully depressing the release 
5 button, so that the shutter 25 is open and closed. Namely, 
the CCD 33 is exposed, and thus an image signal corresponding 
to an image is generated in the CCD 33. The condition 
indicating device 55 is provided with a liquid crystal 
display, by which various setting conditions of the electronic 
10 still camera are indicated. 

Fig. 2 is a block diagram showing a construction of the 

projection unit 53. 

The projection unit 53 is provided with a light 
emitting diode 53a radiating an infrared laser beam and a 

15 projection lens 53b provided in front of the light emitting 
diode 53a. A light emitting operation of the light emitting 
diode 53a is controlled by a light emitting diode control 
circuit 53c, which is operated based on a command signal 
output by the system controller 31 . 

20 Fig. 3 is a view showing an external appearance of the 

interchangeable lens 11 and a focusing ring 61 attached to the 
interchangeable lens 11, the focusing ring 61 being 
disassembled from the interchangeable lens 11 in the drawing. 
The focusing ring 61 is rotatably provided on an outer surface 

25 of the lens barrel 62 of the interchangeable lens 11. The 



focusing ring 61 is connected to a lens moving mechanism, 
which is mounted in the lens barrel 62 and is provided with a 
cam ring and the other components. By rotating the focusing 
ring 61, the lens groups 14 and 15 are moved in the optical 
5 axis direction so that a focusing adjustment is performed. 

A two-dimensional bar code 63, indicating a distance 
from the camera to the subject, is provided on an inner 
surface of the focusing ring 61. A lens support cylinder (not 
shown) , in which the lens groups 14 and 15 are housed, is 

10 disposed in the lens barrel 62. The lens support cylinder is 
fixed to the lens barrel 62, and a photo sensor 64 is attached 
on an outer surface of the 1 en s suppor t cyl i nder . The photo 
sensor 64 has a light emitting diode and a light receiving 
diode, and faces the two-dimensional bar code 63. 

15 A light beam radiated from the light emitting diode is 

reflected on the two-dimensional bar code 63, and is received 
by the light receiving diode. The photo sensor 64 is 
connected to the lens control circuit 17 (Fig. 1) , so that a 
signal, generated in the light receiving diode in accordance 

20 with received light, is input to the lens control circuit 17, 
and is then input to the system controller 31 provided in the 
camera body as a distance signal indicating a distance from 
the electronic still camera to the subject. Namely, the light 
radiated by the light emitting diode and reflected by the two- 

25 dimensional bar code is sensed by the light receiving diode, 
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the distance from the electronic still camera to the subject 
is measured. 

Fig. 4 shows an example of an image PO observed through 
the view-finder. The image PO contains a subject PI 

positioned close to the electronic still camera, a subject P2 
positioned far from the electronic still camera, and a subject 
P3 positioned between the subjects PI and P2 . In this 
embodiment, as described later, only an image area containing 
the subject which is in-focus is extracted from the image, and 
a white balance adjustment is carried out based on an image 
signal regarding the image area. The image area is obtained 
by an operation in which, while the lens groups 14 and 15 
focus on one of the subjects, distances from the camera to the 
subjects PI, P2 and P3 are measured and an image area 
corresponding to the distance signal obtained through the 
photo sensor 64 is detected. 

With reference to Figs. 5 and 6, a principle behind a 
distance measurement in the embodiment is described below. 
Note, in Fig. 6, the abscissa indicates time "t". 

A distance measuring light beam output by a distance 
measurement device B (corresponding to the projection unit 53 
shown in Fig. 1) is reflected by a measurement subject P, and 
the reflected light beam is sensed by the CCD 33 (Fig. 1) . 
The distance measuring light beam is a pulse, a width of which 
is "H w . Accordingly, the reflected light beam is a pulse, a 
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width of which is "H", similarly to the distance measuring 
light beam. Therefore, a rise of the pulse of the reflected 
light beam occurs after a rise of the pulse of the distance 
measuring light beam by a time 5-t (5 is a delay coefficient) . 
5 Since the distance measuring light beam and the reflected 
light beam have both traveled a distance "r" between the 
distance measurement device B and the measurement subject P, 
the distance "r" is represented as follows: 

r = 5-t-C/2 ... (1) 

10 wherein "C" is the velocity of light. 

For example, by setting a condition in such a manner 
that the reflected light beam can only be sensed from a rise 
of the pulse of the distance measuring light beam to a point 
prior to a fall of the pulse of the reflected light beam, 

15 i.e., by providing a gate pulse corresponding to a reflected 
light beam detecting period T, an amount "A" of received light 
from the reflected light beam becomes a function of the 
distance Y. Namely, the greater the distance "r" {or the 
greater the time 5*t) , the less the received light amount A. 

20 In the embodiment, by taking advantage of the principle 

described above, the received light amount A is sensed using 
each of the photo-diodes (photoelectric conversion elements) 
of the CCD 28, the distance from the electronic still camera 
to each point on the surface of the measurement subject P is 

25 sensed, and data of the three-dimensional image, which 
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indicates a topography of the measurement subject P, can be 
obtained concurrently. 

Fig. 7 is a plan view showing a disposition of the 
photo-diodes 71 and a vertical transfer unit 72, which are 
5 provided in the CCD 33. Actually, a multitude of photo-diodes 
71 are arranged in a matrix, and a corresponding vertical 
transfer unit 72 is disposed beside each vertical column of 
photo-diodes 71. Fig. 8 is a sectioned elevational view of 
the CCD 33 in which the CCD 33 is cut in a plane perpendicular 

10 to a substrate 73. The CCD 33 is an interline CCD of vertical 
overflow drain (VOD) type, in which unwanted charge is 
discharged to the substrate 73. 

The photo-diodes 71 and the vertical transfer unit 
(signal charge holding unit) 72 are formed along a surface of 

15 the n-type substrate 73. A plurality of the photo-diodes 71 
are two-dimensional ly disposed in a matrix arrangement, and 
the vertical transfer unit 72 is disposed adjacent to the 
photo-diodes 71, parallel to rows extending in a vertical 
direction in Fig. 7. The vertical transfer unit 72 has four 

20 vertical transfer electrodes 72a, 72b, 72c and 72d, which 
correspond to each of the photo-diodes 71. Therefore, in the 
vertical transfer unit 72, four potential wells can be formed, 
so that a signal charge is output from the CCD 33 by 
controlling a depth of the wells, as is well-known. Note that 

25 a number of the vertical transfer electrodes can be changed, 
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depending upon a requirement of the CCD 33. 

The photo-diodes (PD) 71 and the vertical transfer unit 
(V-CCD, being a signal charge holding unit) 72 are disposed in 
a p-type well formed on a surface of the substrate 73. The p- 
5 type well is completely depleted due to an inverse-bias 
voltage applied between the p-type well and the n-type 
substrate 73. In this state, electric charge is accumulated 
in the photo-diodes 71, and an amount of the electric charge 
corresponds to an amount of an incident light beam, which is 

10 the reflected light beam reflected by the measurement subject. 
When a substrate voltage is changed to a value greater than a 
predetermined value, electric charge accumulated in the photo- 
diodes 71 is discharged to the substrate 73. Conversely, when 
an electric charge transfer signal, which is a voltage signal, 

15 is applied to a transfer gate (TG) 74, the electric charge 
accumulated in the photo-diodes 71 is transferred to the 
vertical transfer unit 72. Namely, after the electric charge 
is discharged to the substrate 73 by the electric charge 
discharging signal, the signal charge accumulated in the 

20 photo-diodes 71 is transferred to the vertical transfer unit 
52 by the electric charge transfer signal. By repeating the 
discharge and the transfer, an electronic shuttering operation 
is performed. 

Fig* 9 is a timing chart of a distance information 
25 sensing operation by which data, corresponding to the distance 
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from the electronic still camera to each point on a surface of 
the measurement subject, is sensed. The distance information 
sensing operation is described below with reference to Figs. 
1, 7 through 9. 

5 In synchronization with an output of a vertical 

synchronizing signal SI, an electric charge discharging signal 
(a pulse signal of negative polarity) S2 is output, so that 
unwanted charge, which is accumulated in the photo-diodes 71, 
is discharged to the substrate 73. Approximately 

10 simultaneously with a completion of the output of the electric 
charge discharging signal S2 , the projection unit 53 is 
actuated, and thus a distance measuring light beam S3, which 
is a pulsed beam having a constant pulse-width, is output 
therefrom. The distance measuring light beam S3 is reflected 

15 by the measurement subject, and enters the CCD 33 as a 
reflected light beam S4 . When a predetermined time has 
elapsed since the output of the distance measuring light beam 
S3, an electric charge transfer signal (a pulse signal of 
negative polarity) S5 is output, so that an electric charge 

20 accumulated in the photo-diodes 71 is transferred to the 
vertical transfer unit 72. Note that the electric charge 
transfer signal S5 is output before the output of a pulse of 
the distance measuring light beam S3 is completed. 

Thus, for a period T ux from the end of the output of the 

25 electric charge discharging signal S2 to the beginning of the 
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output of the electric charge transfer signal S5, signal 
charge corresponding to distances from the electronic still 
camera to the measurement subject is accumulated in the photo- 
diodes 71. Namely, although a period T s , which is from the 
5 fall of the pulse of the distance measuring light beam S3 to 
the rise thereof, and the electric charge accumulation period 
T ai begin approximately simultaneously, the electric charge 
accumulation period T wl ends prior to a completion of the 
period T s , so that only a part of the reflected light beam S4 
10 is detected by the CCD 33. Signal charge S6, generated due to 
the detected light beam, corresponds to the distance from the 
electronic still camera to the measurement subject. In other 
words, the signal charge S6, corresponding to a light beam, 
which is included in the reflected light beam S4 coming from 
15 the measurement subject and which reaches the photo-diodes 71 
within the electric charge accumulation period T ra , is 
accumulated in the photo-diodes 71. The signal charge S6 is 
transferred to the vertical transfer unit 72 by the electric 
charge transfer signal S5 . Note that the period T s , for which 
20 the distance measuring light beam S3 is output, can begin 
prior to the electric charge accumulation period T m , if 
necessary. 

After a predetermined time has elapsed since the output 
of the electric charge transfer signal S5, the electric charge 
25 discharging signal S2 is again output, so that unwanted 
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charge , which is accumulated in the photo-diodes 71 after the 
transfer of the signal charge S6 to the vertical transfer unit 
72 , is discharged to the substrate 73. Thus, further signal 
charge is accumulated in the photo-diodes 71. Then, similarly 
5 to the above description , when the electric charge 
accumulation period T ua _ has again elapsed, the signal charge S6 
is transferred to the vertical transfer unit 72. 

The transferring operation of the signal charge S6 to 
the vertical transfer unit 72 is repeatedly performed until 

10 the next vertical synchronizing signal Si is output. Thus, 
the signal charge S6 is integrated in the vertical transfer 
unit 72, The signal charge S6 integrated for one field 
period, which is between two vertical synchronizing signals 
SI, corresponds to distance information of the measurement 

15 subject, on condition that the measurement subject is 
stationary for tha period between the two vertical 
synchronizing signals SI. 

The detecting operation of the signal charge S6 
described above is carried out in all of the photo-diodes 71 

20 provided in the CCD 33. As a result of the detecting 
operation for one field period, the distance information 
sensed by the photo-diodes 71 is held in each corresponding 
vertical transfer unit 72, which is located adjacent to each 
column of photo-diodes 71. The distance information is output 

25 from the CCD 33 by a vertical transferring operation of the 



vertical transfer units 72 and a horizontal transferring 
operation of a horizontal transfer unit (not shown) . The 
distance information is then converted to digital data by the 
A/D convertor 38, and is stored in the memory 40 through the 
image signal processing circuit 39. 

Figs. 10A and 10B show a flowchart of a routine by 
which an image area containing the in-focus subject is 
extracted and a white balance adjustment is performed based on 
an image signal corresponding to the image area. The routine 
is executed in the system controller 31 and is described with 
reference to Figs. 1, 3, 10A and 10B. 

In Step 101, it is determined whether the photometry 
switch provided in the operation switch 54 is turned ON. When 
the photometry switch is turned ON, Step 102 is executed in 
which an exposure calculation is carried out based on a 
photometry value obtained by the photometry sensor 52. 
Namely, an aperture value and a shutter speed are obtained. 

In Step 103, the lens groups 14 and 15 are moved along 
the optical axis, so that an automatic focusing (AF) operation 
is performed. The focusing condition is sensed by the AF 
sensor 51, and each of the lens groups 14 and 15 is set to a 
position where an in-focus condition is obtained, by an 
operation of the lens control circuit 17. The AF operation is 
carried out in such a manner that a subject positioned at the 
center, for example, of an image obtained through the lens 
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groups 14 and 15 is in-focus. In Step 104, a rotational 
position of the focusing ring 61, i.e. a distance from the 
electronic still camera to the in-focus subject is obtained 
based on a relative position of the photo sensor 64 to the 
5 two-dimensional bar code 63. A distance signal obtained 
through the photo sensor 64, i.e. in-focus distance data is 
stored in a memory (not shown) provided in the system 
controller 31. 

In Step 105, it is determined whether the release 

10 switch provided in the operation switch 54 is turned ON. When 
the release switch is turned OFF, the process goes back to 
Step 101, so that the operations described above are again 
executed. Conversely, when the release switch is turned ON, 
Step 106 and the following Steps are executed. 

15 In Step 106, an exposure operation is started. Namely, 

the quick return mirror 21 is rotated or set to a horizontal 
state, the opening degree of the aperture 16 is controlled to 
an amount corresponding to an aperture value set in Step 102 , 
and the shutter 25 opens. In Step 107, it is determined 

20 whether an exposure period, which corresponds to a shutter 
speed obtained by the exposure calculation of Step 102, has 
elapsed. When the exposure period has elapsed, the process 
goes to Step 108, so that the exposure operation is stopped. 
Namely, the shutter 25 is closed, the quick return mirror 21 

25 is set to an inclined state, and the aperture 16 is fully 
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opened . 

In Step 109, an image signal, generated in the CCD 33 
due to the exposure operation of Steps 106 through 108, is 
read. The image signal is converted to digital image data by 
5 the A/D convertor 38, and is then subjected to a predetermined 
process by the image signal processing circuit 39. The 
digital image data is stored in a first area of the memory 40. 
In Step 110, it is determined whether the reading operation of 
the image signal from the CCD 33 has been completed. When the 

10 reading operation has not been completed, Step 109 is 
repeatedly executed- Conversely, when the image signal 
corresponding to one frame image has been read from the CCD 33 
and has been stored in the memory 40, the process goes from 
Step 110 to Step 111, so that an operation is carried out to 

15 sense three-dimensional image data indicating a distance from 
the electronic still camera to each point on the surface of 
the subject. 

In Step 111, the exposure operation is again started. 
Namely, the quick return mirror 21 is again set to the 
20 horizontal state, and the opening degree of the aperture 16 is 
set to an amount for performing a sensing operation of the 
three-dimensional image data. Further, the shutter 25 opens. 
In Step 112, an electric power is supplied to the projection 
unit 53. In Step 113, controls of the projection unit 53 and 
25 the CCD 33 are started to perform a sensing operation of 
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three-dimensional image data. Namely, a pulse of a distance 
measuring light beam is output by the projection unit 53, a 
reflected light beam from the subject is received by the CCD 
33 , and a signal charge generated due to the reflected light 
5 beam is integrated in the CCD 33. 

In Step 114, it is determined whether the sensing 
operation of the three-dimensional image data has been 
completed, i.e. whether the three-dimensional image data has 
been read from the CCD 33 and has been stored in a second area 

10 of the memory 40. When the storing operation of the three- 
dimensional image data has not been completed, Step 113 is 
repeatedly executed. When the storing operation of the three- 
dimensional image data has been completed, the process goes to 
Step 115, in which the exposure operation is stopped. Namely, 

15 the shutter 25 is closed, the quick return mirror 21 is set to 
an inclined state, and the aperture 16 is fully opened. Then, 
Step 116 is executed in which the projection unit 53 is 
extinguished . 

In Step 117, based on the in-focus distance data 
20 obtained in Step 104 and the three-dimensional image data 
obtained in Step 113, one image area is extracted from the one 
frame image. For example, by selecting pixels, corresponding 
to points within a predetermined range from a distance 
indicated by the in-focus distance data which is deemed as the 
25 center, from the image data stored in the memory 40 in Step 
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109, the image area formed by the selected pixels is obtained. 
The image area corresponds to an image which contains subjects 
located at approximately the same distance as the subject PI, 
when only the subject PI is in-focus in the example shown in 
Fig. 4. 

In Step 118, a part in which a value of color 
differential data, obtained based on the image data contained 
in the image area extracted in Step 117, is within a 
predetermined range, i.e., an achromatic image is extracted. 
In Step 119, an average value of color differential data 
corresponding only to the achromatic image obtained in Step 
118 is obtained, and is stored in the memory 40 as a control 
amount for a white balance adjustment. In Step 120, using the 
control amount obtained in Step 119, the white balance 
adjustment is applied to the image data which is stored in the 
memory 40 in Step 109. Since the white balance adjustment is 
well known, an explanation thereof is omitted. 

As described above, in the first embodiment, only an 
image area is extracted which is formed by image data 
corresponding to a subject located at approximately the same 
distance as the in-focus subject. Then, an achromatic image 
is extracted from the image of the extracted image area, and 
the control amount of the white balance adjustment is 
calculated based on only the achromatic image. Therefore, the 
white balance adjustment is always performed with regard to 
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the in-focus subject , so that an appropriate color expression 
can be always obtained for the subject. 

Figs. 11A and 11B show a flowchart of a white balance 
adjustment routine of a second embodiment. The other 
5 constructions are the same as the first embodiment. 

When it is confirmed in Step 201 that the photometry 
switch is turned ON, Step 202 is executed in which an exposure 
calculation is carried out based on a photometry value 
obtained by the photometry sensor 52 , so that an aperture 

10 value and a shutter speed are obtained. In Step 203, the lens 
groups 14 and 15 are moved along the optical axis, so that an 
AF operation is performed so that the lens groups 14 and 15 
are set to predetermined positions. In Step 205, it is 
determined whether the release switch is turned ON. When the 

15 release switch is turned OFF, the process goes back to Step 
201, and when the release switch is turned ON, Steps 206 and 
the following Steps are executed. 

Operations of Steps 206 through 216 are identical to 
those of Steps 106 through 116. 

20 In Step 217, based on the three-dimensional image data 

obtained in Step 213, a single image, corresponding to image 
data obtained in Step 209, is divided into three image areas, 
for example. Namely, as shown in Fig. 4, for example, a 
single image P0 is divided into a first image area P10 

25 composed of a subject PI of a short distance, a second image 
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area P20 composed of a subject P2 of a long distance, and a 
third image area P30 composed of a subject P3 of an 
intermediate distance. Note that, although, in Fig. 4, 
outlines of the image areas P10, P20 and P30 are shown as 
rectangular similarly to the original image PO , actually, each 
of the image areas P10, P20 and P30 is divided by clear 
boundary lines, which are usually not rectangular. The 
division of the image areas will be described later. 

In Step 218, image data of the first image area P10 is 
extracted. In Step 219, a part in which a value of color 
differential data, obtained based on the image data contained 
in the image area extracted in Step 218, is within a 
predetermined range, i.e., an achromatic image is extracted. 
In Step 220, an average value of color differential data 
corresponding only to the achromatic image obtained in Step 
219 is obtained, and a white balance adjustment of the 
corresponding image area is performed using the average value 
as a correction amount of the white balance adjustment. 

In Step 221, it is determined whether the white balance 
adjustment has been completed for all of the first, second and 
third image areas. When the white balance adjustment has not 
been completed for all of the image areas, Step 222 is 
executed, in which image data of the next image area is 
extracted. Then, Steps 219 and 220 are again executed, and 
the white balance adjustment is carried out for the image 
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area. When it is determined in Step 221 that the white 
balance adjustment has been completed, the white balance 
adjustment routine ends . 

With reference to Fig. 12, the division of the image 
areas executed in Step 217 of Fig. 11B is described. Fig. 12 
is a histogram, in which a reciprocal number of a distance "d" 
from the electronic still camera to the subject is defined as 
the abscissa and a number of pixels corresponding to the 
distance is defined as the ordinate. 

A histogram of distance information is made regarding 
all of the pixels forming the three-dimensional image data 
obtained in Step 213. Since pixels of infinity are contained 
in the photographed image, if a distance is defined as the 
abscissa of the histogram, the abscissa of the histogram would 
be extended to infinity. Further, the minimum distance at 
which a photographing operation can be performed, is finite. 
Therefore, a reciprocal number of the distance "d" is defined 
as the abscissa, and the maximum value of the abscissa is set 
to a finite value. 

As shown in Fig. 4, when three subjects PI, P2 and P3, 
in which distances from the electronic still camera are 
different, are included in a single image, three peaks 
including infinity, i.e. a point of l/d=0 exist in the 
histogram. Namely, the subject P2 is located at infinity, and 
the second image area P20 containing the subject P2 
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corresponds to the left peak PKO of the histogram. The 
subject P3 is located at an intermediate distance, and the 
third image area P30 containing the subject P3 corresponds to 
the center peak PK1 of the histogram. The subject PI is 
located at a short distance, and the first image area P10 
containing the subject PI corresponds to the right peak PK2 of 
the histogram. 

A minimal point, which is positioned at the equal 
distance from the adjacent peaks PKO and PK1 , is defined as a 
first boundary VI, and a minimal point, which is positioned at 
the equal distance from the adjacent peaks PK1 and PK2 , is 
defined as a second boundary V2 . In Fig. 4, the second image 
area P20 corresponds to a histogram positioned at a left side 
of the first boundary VI, and the third image area P30 
corresponds to a histogram positioned between the first and 
second boundaries VI and V2 . The first image area P10 
corresponds to a histogram positioned at a right side of the 
second boundary V2 . 

As described above, in the second embodiment, a single 
image is divided into a plurality of image areas in accordance 
with a distance from the electronic still camera to the 
subjects, and for each of the image areas, a white balance 
adjustment is performed using image data of an achromatic part 
of the image area. Therefore, the white balance adjustment is 
properly performed for the image as a whole. 



Although the embodiments of the present invention have 
been described herein with reference to the accompanying 
drawings, obviously many modifications and changes may be made 
by those skilled in this art without departing from the scope 
of the invention. 

The present disclosure relates to subject matter 
contained in Japanese Patent Application No. 11-201136 (filed 
on July 15 , 1999) which is expressly incorporated herein, by 
reference, in its entirety. 
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CLAIMS 

1. A device for calculating a white balance control amount 

for an electronic still camera, comprising: 

an image signal generating processor that generates an 
5 image signal corresponding to a first image formed on a light 
receiving surface of an imaging device ; 

an image area extracting processor that extracts at 
least one image area, which contains a second image of a 
subject positioned at a predetermined distance from said 
10 electronic still camera, from said first image; and 

a control amount calculating processor that calculates 
a control amount for performing a white balance adjustment, 
based on said image signal relating to said at least one image 
area. 

15 2. A device according to claim 1, wherein said image area 

extracting processor extracts a single image area, and said 
control amount calculating processor calculates said control 
amount, based on said image signal relating to said single 
image area which is extracted by said image area extracting 

20 processor. 

3. A device according to claim 2, wherein said second 

image is in-focus, and said single image area is extracted by 
selecting pixels from said first image, said pixel 
corresponding to points within a predetermined range from said 
25 predetermined distance. 
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4. A device according to claim 1, wherein said image area 
extracting processor extracts a plurality of image areas from 
said first image , and said control amount calculating 
processor calculates said control amount for each of said 

5 plurality of image areas. 

5. A device according to claim 4, wherein said image area 
extracting processor divides said first image to obtain said 
plurality of image areas f based on distances of subjects 
included in said first image. 

10 6. A device according to claim 1, wherein said control 

amount calculating processor extracts a third image composed 
of an achromatic color from said second image of said image 
area extracted by said image area extracting processor^ and 
calculates said control amount based on only said third 

15 image. 

7, A device according to claim 1, wherein said image area 
extracting processor comprises a three dimensional image data 
sensing processor that senses three dimensional data 
indicating a distance from said electronic still camera to 

20 each point on a surface of said subject. 

8. A device according to claim 7, wherein said three 
dimensional image data sensing processor comprises a light 
source radiating a distance measuring light beam onto said 
subject, and a three dimensional image signal generating 

25 processor that generates three dimensional data indicating a 
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distance from said electronic still camera to each point on a 
surface of said subject. 

9. A device according to claim 8, wherein said three 
dimensional image signal generating processor comprises said 

5 image signal generating processor. 

10. A device according to claim 8, wherein said three 
dimensional image signal generating processor comprises: 

a plurality of photoelectric conversion elements that 
receive a reflected light beam from said subject, so that 
10 signal charge corresponding to an amount of said received 
reflected light beam is accumulated in each of said 
photoelectric conversion elements; 

a signal charge holding unit disposed adjacent to each 
of said photoelectric conversion elements; 
15 an electric charge discharging processor that 

discharges unwanted charge accumulated in each of said 
photoelectric conversion elements, so that said accumulation 
of said signal charge is started in each of said photoelectric 
conversion elements ; 
20 a signal charge transfer processor that transfers said 

accumulated signal charge in said photoelectric conversion 
elements to said signal charge holding unit; and 

a signal charge integrating processor that drives said 
electric charge discharging processor and said signal charge 
25 transfer processor alternately, so that said signal charge is 
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integrated in said signal charge holding unit. 

11. A device for calculating a white balance control amount 

for an electronic still camera which photographs an image 
containing at least one subject and at least one portion other 
5 than said at least one subject, said white balance control 
amount calculating device comprising: 

an imaging device by which an image signal 
corresponding to said image is generated; 

an image area extracting processor that extracts at 
10 least one image area, each containing one of said at least one 
subject, from said image; and 

a control amount calculating processor that calculates 
a control amount for performing a white balance adjustment, 
based on said image signal relating to said image area. 
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WHITE BALANCE CONTROL AMOUNT CALCULATING DEVICE 

5 ABSTRACT OF THE DISCLOSURE 

A white balance control amount calculating device, 
provided in an electronic still camera, comprises an imaging 
device by which an image signal of a subject is sensed. Based 

10 on the image signal, a single image is divided into three 
image areas, for example. The first image area contains a 
first subject which is located at a short distance from the 
electronic still camera. The second image area contains a 
second subject which is located at infinity. The third image 

15 area contains a third subject which is located at a distance 
between the first and second subjects. An image area, in 
which a subject image is in-focus. is extracted from the three 
image areas. A control amount for a white balance adjustment 
is obtained based on image data corresponding to the extracted 

20 image area. 
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FIG. 8 
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FIG. 10A 



(white balance adjustment routine) 
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FIG. 10B 



PROJECTION UNIT TURNED ON 



112 



PROJECTION UNIT AND CCD OPERATED 
AND THREE-DIMENSIONAL IMAGE DATA SENSED 



NO 



113 



< ^ THREE-DIMENSIONAL IMAGE DATA SENSEdT^ T 



114 



YES 



EXP. OPERATION STOPPED 



PROJECTION UNIT TURNED OFF 



•115 



•116 



IMAGE AREA CORRESPONDING 
TO IN-FOCUS DISTANCE DATA EXTRACTED 



•117 



PART EXTRACTED, IN WHICH COLOR DIFFERENTIAL 
SIGNAL IS WITHIN RANGE 



-118 



AVERAGE VALUE OBTAINED 
AND SET TO CONTROL 
AMOUNT OF WHITE BALANCE ADJUSTMENT 



119 



WHITE BALANCE ADJUSTMENT 



120 



( END ) 



9/11 



FIG. 11A 

(white balance adjustment routine) 
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FIG. 11B 
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